Int J Life Cycle Assess (2012) 17:876-891 
DOI 10.1007/sl 1367-012-0415-x 


SUSTAINABLE DEVELOPMENT 


Weighting environmental effects: Analytic survey 
with operational evaluation methods and a meta-method 

Gjalt Huppes • Lauran van Oers • Ugo Pretato • 

David W. Pennington 


Received: 25 March 2011 / Accepted: 18 March 2012 /Published online: 3 May 2012 
© The Author(s) 2012. This article is published with open access at Springerlink.com 


Abstract 

Purpose The purpose of this paper is to supply an open 
method for weighting different environmental impacts, open 
to basically different evaluation approaches and open to 
easy revisions. From the partial, diverse and conflicting 
weighing methods available, a most consistent and flexible 
meta-method is constructed, allowing for a transparent dis¬ 
cussion on weighting. 

Methods The methods incorporated are as general as possi¬ 
ble, each single one being as pure as possible. We surveyed 
encompassing operational methods for evaluation, applica¬ 
ble in LCA and in larger systems like countries. They differ 
in terms of modelling, as to midpoint or as to endpoint; as to 
evaluation set-up, in terms of collective preferences or indi¬ 
vidual preferences; and as to being either revealed or stated. 
The first is midpoint modelling with collectively stated 
preferences, with operational weighting schemes from 
Dutch and US government applications. Second is the LCA- 
type endpoint approach using individual stated preferences, 
with public examples from Japan and the Netherlands. The 
third is the integrated modelling approach by economists. 
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Results All methods are internally inconsistent, as in terms 
of treatment of place and time, and they are incomplete, 
lacking environmental interventions and effect routes. We 
repaired only incompleteness, by methods transfer. Finally, 
we combined the three groups of methods into a meta¬ 
weighting method, aligned to the ILCD Handbook require¬ 
ments for impact assessment. Application to time series data 
on EU-27 consumption shows how the EU developed in 
terms of overall environmental decoupling. 

Conclusions The disparate methods available all can be 
improved substantially. For now, a user adjustable meta¬ 
method is the best option, allowing for public discussion. 
A flexible regularly updated spreadsheet is supplied with the 
article. 

Keywords Decoupling • Eco-efficiency • ILCD impact 
assessment • Problem shifting • Weighting 

1 Introduction 

The core question in this paper is how environmental con¬ 
siderations can play a consistent role in practical decision 
making, covering all relevant effects of actions on the envi¬ 
ronment. Sustainability requires consistent choices regard¬ 
ing environmental effects also in relation to economic 
performance. Environmental quality should be achieved at 
lowest possible costs, or for given costs the environmental 
performance should be maximized. See the box example on 
how easy it is to deviate from this basic principle of ratio¬ 
nality, in the sense of avoiding sub-optimality. Several 
approaches for overall evaluation have developed. We 
sketch the background to these developments and a way to 
come to a flexible but unified method, open to reasoned 
further development. 
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Six decades ago, von Neumann and Morgenstem (1944) 
formulated requirements on rational decision making. A 
decision maker in a multi-attribute world is rational if his 
choices can be explained by at least one set of weights on 
each of the relevant effect types involved. How to decide in 
an optimal way became a main subject in the fifties and 
sixties, with the Arrow’s (1950) impossibility theorem guid¬ 
ing the discussion: we cannot generally have optimality in 
multi-actor decision making. Sen (1970) has refined the 
requirements for avoiding sub-optimality, as by adding cri¬ 
teria like that outcomes of a choice process should not 
depend on the presence of irrelevant alternatives. The dis¬ 
cussion has then broadened into what empirical criteria to 
use, including value-based criteria on distributional effects 
and justice. Rawls’ (1971) difference strategy has been most 
influential, leading to the position that increased inequality 
may be justifiable as long as it benefits the poorest. In that 
discussion, the Brundtland sustainability criteria have come 
up, with emphasis on distribution within and between gen¬ 
erations (Anonymous 1987), giving more precedence to 
justice than to welfare. With all these normative approaches, 
environmental effects and environmental quality play an 
indispensible role in the evaluation of options. In decision 
theory complex cases are referred to in terms of multi¬ 
attribute situations (see, e.g., Scholz and Tietje 2002; 
Higgins et al. 2008). 

Two decades ago, environmental analysis of products 
(goods and services) developed as LCA, with the operation¬ 
al definitions of environmental effects in terms of impact 
categories. The large number of interventions, i.e., emis¬ 
sions and extractions, related to a case study is called the 
inventory list. By the procedure of characterisation the 
interventions are aggregated into a limited number of impact 
categories. The modelling of the effects in terms of impact 
categories can be at a midpoint (state) or an endpoint (dam¬ 
age) level. These endpoint impact categories typically ex¬ 
press indicators into three Areas of Protection (AoP), like 
human health, ecosystem health and resources. A recom¬ 
mended set of characterisation factors has recently been 
developed coordinated by the EC-JRC (see ILCD 
Handbook on LCIA; EC-JRC 2011, and the two earlier 
documents EC-JRC 2010a; EC-JRC 2010b). The AoP and 
impact categories are listed in Table 2. In this article, the 
characterisation is based on this ILCD recommended set of 
characterisation factors. The specification of endpoint 
effects can be much more uncertain and incomplete than 
midpoint modelling and generally has not been agreed upon 
let alone been standardised. So, the most reliable and de¬ 
tailed environmental information has often become avail¬ 
able at midpoint impact category level. Both midpoint and 
endpoint scores are multiple scores. With operational mod¬ 
els and data specifying these different dimensions, the prob¬ 
lem of weighting came on the agenda. Overall judgements 


are required. Clearly, they are not a subject for empirical 
science but for normative evaluation. 

One of the first quantified weighting exercises was in the 
Netherlands, where government officials in a panel agreed 
upon a set of preference based weights, in 1995, to be used 
in a Covenant with the Netherlands Oil and Gas Exploration 
and Production Association (NOGEPA), see Sas et al. 
(1996). An update of these weighting factors has been made 
in 2005, see Huppes et al. (2007), now being used in the 
meta-weighting method developed here, in one of the three 
basic options. It is combined with similar but later 
approaches from the US, BEES and EPA, both used in the 
realm of sustainable building (see Lippiatt 2007). The meth¬ 
od of weighting by then was clear. Weights are ratio-scale 
attributes, with an overall score resulting from weighted 
addition. The necessary normalization to the same dimen¬ 
sion is to be based on external normalization. This is in 
contrast to project based internal normalization as usual in 
other domains of decision theory. This choice fits the ratio¬ 
nality criterion of Sen (1970) that the preferred outcomes 
should not depend on irrelevant alternatives. The case spe¬ 
cific internal normalization may easily violate this criterion 
except in most simple cases. Formulated first by Heijungs et 
al. (1992), Norris (2001) showed the differences also with 
convincing examples. External normalization is to be used 
in LCA evaluation procedures for reasons of social rational¬ 
ity, for avoiding arbitrariness at a case level. 

Finnveden (1997) asked the basic question: where are the 
values? In fundamental evaluation discussions, we ideally 
would link environmental effects to values. Hofstetter 
(1998) has been one of the early contributors to the discus¬ 
sion, showing how preferences differ between cultural per¬ 
spectives, attitudes, and stakeholders, see also Mettier and 
Hofstetter (2005). Divergent approaches were coming up 
then already (see Notarnicola et al. 1998). Finnveden’s 
question remained on the table as values relate to differences 
in preferences here, not to the items specified in the envi¬ 
ronmental effect scores. Value reasoned weighting has not 
yet been established. One answer came from Powell et al. 
(1997), who looked for sources of valuation as expressed by 
relevant groups in society, using representative panels. They 
avoid the cultural relativism of Hofstetter and look for 
authoritative answers, either from a democratic perspective 
as expressed preferences of “the people” or as expressed 
preferences of their representatives, governments. They also 
investigate the option of policy targets based weights, as 
public preferences, but indicate that the suppositions for 
using targets are so extreme as not being met in practice 
now and hardly to be met at all. The democratic approach 
remains then for them, as the willingness-to-pay or to accept 
the consequences of environmental interventions. This line 
of reasoning is the one used in cost-benefit analysis for 
specifying non-market effects. Results have been coming 
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in based on increasingly sophisticated analysis. They are 
used in the meta-method as developed here as the second 
option, with results of the EU New Energy Externalities 
Development for Sustainability (NEEDS) project as a main 
basis, using integrated modelling (see Preiss et al. 2008). A 
third line of reasoning reduces the number of different items 
to weigh by advancing empirical modelling from midpoints 
to endpoints. The Ecolndicator 1999 is a main example 
(Goedkoop and Spriensma 2000), with later expansions in 
the ReCiPe project (see Heijungs 2008). The simplification 
of having a more limited number of effect categories is 
bought at a price though: there are fundamental limitations 
in validity and reliability of this modelling step. The weight¬ 
ing step, next, is ultimately based on a panel method, with 
persons or organizations expressing their preferences, as in 
the economists’ approach. One difference with the integrated 
modelling methods of economists is that a time specification 
is lacking. The time horizons involved hence cannot play a 
role. Especially with long term effects as in climate change 
and eco-toxicity, differences with the economists approach 
may be substantial. As LCA is mostly not time-specified, 
there is an inconsistency here which cannot be avoided. 

Many practical weighting sets have been developed com¬ 
bining different approaches and methods, and often using 
proxies to cover gaps in explicit value and preference state¬ 
ments. In selecting operational methods to be used in the 
meta-method several criteria play a role. First, we have tried 
to stick to pure types, to remain as open as possible to 
scrutiny on the validity and reliability of the results of the 
combined method, the meta-method. Second, we discarded 
methods using a single criterion to the exclusion of all other 
criteria. Third, we selected methods with a minimum of 
scientific robustness, as in not violating Sen’s independence 
of irrelevant alternatives criterion. Finally, we focused on 
methods with some authoritative backgrounds and applica¬ 
tions, as by governments. Midpoint methods from the LCA 
domain were clearly established, as are the economic valu¬ 
ation methods. Endpoint impact assessment methods linked 
to weighting are less developed, but constitute an interesting 
link between LCA midpoint and economic endpoint 
approaches. We decided to include some recently developed 
endpoint method, even though less clearly developed and 
less authoritative. To give an example on the selection 
process, the EPS method (Steen 1999a,b; see also 
Bengtsson and Steen 2000) uses a combination of hedonic 
pricing, contingent valuation and public expenditure and 
combines these with substantial corrections by the authors 
into one weighting method. Though used in practice, this 
method is not included in the operational set due to its 
diverse underlying methods. 

We did not develop new methods but use existing meth¬ 
ods for evaluation, expanding them somewhat for broad and 
comparable application in a most consistent way. Lundie 


and Huppes (1999) in a practical way tried to narrow down 
the range of weighting sets which might reasonably be 
applied. Softly, this narrowing down approach is followed 
here, by using basically different approaches in the meta¬ 
weighting set. As this set is available in a free downloadable 
operational spreadsheet, the meta-weights can be set by the 
user (see Appendix 1). One default set is supplied for an 
easy starting application. For the moment this seems the 
most reasonable way to deal with the thousands of environ¬ 
mental interventions which are invoked in any technologies 
related decision. Though there will never be a final position 
in weighting, intermediate and preliminary positions are 
required to focus the discussion. 

The meta-weighting method can be applied in the usual 
LCA product-function domain, by firms, NGOs, consumers 
and governments. But it may also be used for more aggre¬ 
gate applications, covering broader system, like energy sys¬ 
tems, and more aggregate units like total consumption in a 
country or the total of all economic activities in a country, as 
with data supplied in environmentally extended Input- 
Output Analysis. We will focus on a most aggregate example 
here: total society. By applying it to yearly totals of environ¬ 
mental interventions we can measure the overall performance 
of society, similar to measuring national income. Combining 
these macro level applications we can establish in how far 
environmental performance and economic performance are 
decoupling. The corollary at a micro level would be eco- 
efficiency analysis, as environmental intensity. 


Box: Decision making with complex economic and environmental 
effects 

Simplified examples are difficult to understand and resolve already. 
Let us start with decision making in a simple situation. We have two 
options for environmental investments. One is increasing energy 
efficiency of waste incineration by high-temperature burners. The 
additional costs are €1 million per year, saving 30,000 tons of C0 2 
emissions, but increasing NO x emissions by 2,000 tons, contributing 
to acid rain and eutrophication. The other option is to install im¬ 
proved DeNOx installations in the five existing electricity plants in the 
city. Each costs €200,000 per year in additional cost and leads to a 
reduction of 400 tons of NO x . However, the additional energy use 
involved, included in the cost, leads to additional emissions of 4,000 
tons of C0 2 . What to do? What is best? Along comes a convincing 
environmentalist: “Let’s be environmentally effective! Let’s do them 
all: One for the climate and the five for the acid rain.” And so it is 
decided. All is done and €2 million is spent per year. As to the 
environmental impact of this decision, C0 2 emissions remain the 
same, as the plusses and minuses exactly balance. The NO x emission 
reductions balance to zero as well. So there is no net environmental 
improvement at all. Quite a large sum of money is spent to no avail in 
terms of climate and acidification, and the activities definitely will 
have other negative environmental impacts, like on resource deple¬ 
tion and toxicity. Would either of the options alone have been better? 
Which one? How to answer that question? Based on one’s personal 
preferences or based on broader societal considerations? Would these 
choices have contributed to decoupling of economic growth from 
environmental impact? Would these decisions have been sustainable? 
Some overall measure on environmental performance then is needed, 
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requiring weighting, as operational evaluation, and some way of 
balancing against cost. 

More real situations are more complex. The example of only two 
technologies with only two emissions and two impact categories 
involved is artificial and non-existent. In real life, myriads of deci¬ 
sions are made, each with many options and each with thousands of 
different environmental interventions involved, ranging from re¬ 
source extractions and different types of land use to emissions of 
large number of different substances, radiation and noise. Real sit¬ 
uations always are complex, without an easy dominance analysis 
leading to clear choices. 

Weighting is unavoidable , better explicit than implicit. In any specific 
choice, virtually all environmental impacts are involved, as are 
economic value creation and its negative counterpart costs. We 
cannot avoid the weighing between them. We may choose to make 
the choice implicitly. We then close our eyes for the nasty 
interrelations and the partly disappointing consequences involved. 
Explicit treatment will require some form of weighting, if only to get 
some overview. Also, we not only may want to make wise decisions 
on a product system, but also want to know if we have done well at a 
more aggregate level, as a firm, or as society, and if future 
developments go in the right direction. Did we take the right 
decisions in the past? How do we compare to others? Dow we have 
the right policies in place? Also, at this aggregate level, we need 
some overview “how we did environmentally,” requiring aggregation 
which by necessity is based on weighting. 

Weighting is not easy. The different environmental impact categories 
give insight in effect mechanisms, with reasonable validity, but also 
with discussion, as for example on the exact mechanisms of climate 
change. These environmental impacts are very diverse, with relations 
towards endpoints highly disputable as to mechanisms and 
completeness, and conditions for them to occur. To complicate 
matters, many environmental stressors work out with delays; they 
may last for different periods (extinction is forever); and they may 
interrelate. Fine dust has health effects ranging from simultaneous to 
life time, climate changing emissions have different time horizons, 
with climate change being influenced for up to centuries and 
millennia. Getting an overall view of “how we are doing” requires 
reconciling these different frames, in one evaluation framework. 


2 Paper outline 

We first surveyed the field of weighting methods, develop¬ 
ing a framework for typifying options. Next, we chose three 
basic approaches, each most consistent in itself, and filled 
with a number of operational methods. These three 
approaches are developed operationally for our purpose 
here. We expanded their applicability to the broadest and 
most generally specified level, based on the ILCD 
Handbook on LCIA (EC-JRC European Commission-Joint 
Research Centre 2011) as the reference for characterisation 
in LCA. To show how they work out we applied them to a 
time series of emission data for the EU. This data set has 
been chosen as reflecting the broadest set of environmental 
interventions for aggregate performance of society now 
available. Finally, the question is how to deal with these 
three different weighting options? At an aggregate level of 
one country, they lead to very similar outcomes. For 


different countries and sectors the outcomes might be more 
disparate. And for application at a micro level of specific 
technologies and policies, they will certainly differ in their 
outcomes. As they have different strengths and weaknesses 
a mixed approach is developed, where the methods in the 
three approaches are combined into one, as a meta¬ 
weighting method. The result is available as a spreadsheet, 
applicable to a broad set of environmental interventions. It 
can also be applied in a disaggregated way, showing the 
relative importance of specific environmental interventions 
and of specific impact categories. The easy choice of em¬ 
phasis between the weighting methods also allows for an 
active sensitivity analysis. 

3 Framework 

The framework to describe the different weighting approaches 
builds on two main issues: (1) the place in the cause-effect 
chain where weighting is applied and (2) the type of values 
and preferences involved in weighting and the basis for mea¬ 
suring these. The approaches for impact assessment and 
weighting across impact categories differ in the extent to 
which the causal effect chains are modelled in characterisa¬ 
tion, hence differ where the subsequent weighting starts to be 
applied. Effect levels may be distinguished in midpoint and 
endpoint effects, i.e., in terms of Drivers - Pressures - State - 
Impact - Response (DPSIR) (see the ETDS of the European 
Environment Agency) respectively as State and Damage indi¬ 
cators. The weighing applied at midpoint outcomes implies an 
implicit judgement on further empirical effects. 

As to the actual weighting across impact categories, 
either defined at midpoint or endpoint level, weighting sets 
can be classified into different families depending on how 
the weighting is performed and on which basis. Figure 1 
presents a taxonomy of weighting approaches that specifies 
main types of methods used to arrive at a single score. Some 
methods are not really weighting methods, like single item 
methods which pick out “the” main effect type, as in the 
footprint. Next, there are value-based and preference-based 
methods. Value-based judgements focus on one aspect 
corresponding to one value. Each value constitutes a reason 
why one option is preferred to another. These considerations 
are of a mainly qualitative nature. With several values being 
relevant, lexicographic ordering of values then may form the 
basis for ordering options. One value domain then is more 
important than all other values together, without any 
trade-offs. In the environmental domain, this seems 
highly improbable. Hence, only in very exceptional sit¬ 
uations may some alternative be dominant (or dominat¬ 
ed) in all value domains. Value-based ordering will 
normally not lead to a relevant resolution when com¬ 
paring closely related options. 
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Fig. 1 Taxonomy of weighting 
approaches. 1. Willingness-to- 
pay, marginal, for emission/ 
damage reduction or prevention 
in current (or reference) emis¬ 
sion situation. 2. Willingness- 
to-pay, marginal, for emission/ 
damage reduction in hypotheti¬ 
cal optimum situation. 3. Mar¬ 
ginal cost to reach stated 
emission (reduction) target. 
Idem for higher reduction target 
3'. 4. Currently induced highest 
marginal cost of emission re¬ 
duction. 5. Current private 
marginal expenditure for emis¬ 
sion/damage prevention. 6. 
Budget limit for marginal 
willingness-to-pay for damage 
reduction, current income, cur¬ 
rent situation (as the area under 
the red curve) 
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Methods based on preferences, with quantified trade-offs 
being specified, are most relevant for the development of a 
quantified weighting tool for decision making regarding 
complex environmental effects. These may be further dis¬ 
tinguished as to the kind of preferences involved. These may 
refer to what concerns an individual as the judge of effects, 
i.e., how do you, as a private person, value effects of climate 
change in your life, and thereafter, for yourself, and others? 
These are individual preference methods, based on individ¬ 
ual utility, leading to monetized values with easy trade-offs 
also with other domains where money values are used. 
There are, however, reasons why other considerations may 
play a role which is not covered by such individual prefer¬ 
ences. One main example relates to societal risk aversion. 
Objections to low chance/high impact effects of nuclear 
installations or climate change may be based on collective 
justice considerations as well as on the fear of unforeseeable 
social and cultural disruption. Such normative and empirical 
reasoning in evaluation goes beyond the expected value of 
effects based on private preferences. It is more value-based, 
not easily allowing for the establishment of trade-offs. Such 
values may however be reflected in collective preferences, 
in a not so easily specified way. The high impact with 
limited overall effect is the other extreme where utility- 
based methods do not work. Statistical death is allowable. 
We all accept the risk of death in traffic. However, certain 
death of specific persons just is not allowable; that would be 
murder. See Ackerman and Heinzerling (2004, p. 205 ff) for 


an eloquent survey on the limitations of utility-based mon¬ 
etisation of external effects. 

The final distinction in Fig. 1 pertains to measurement of 
preferences, either through explicit statements, as stated 
preferences, or derived from decisions actually done, as 
revealed preferences. Revealed preferences are derived from 
how decisions are actually made, inferring the preferences 
from the decisions and their assumed, modelled consequen¬ 
ces. However, revealed preferences can reflect choices of 
the past only and are difficult to apply in situations where 
very many characteristics are relevant for choices. 
Therefore, they cannot guide new policies, for example, 
based on new insights in the seriousness of the effects of 
climate change. Direct statements on preferences are an 
expression on what is to be preferred over what, i.e., which 
set of environmental effects is considered to be more im¬ 
portant over another full set. How such statements are 
collected is very open. A much used method is asking 
persons or public bodies to rank alternatives. This method 
is flexible but prone to manipulation and inconsistency. 
However, for the judgement of future impacts of emissions 
the weighting sets based on direct statements seem to be the 
most appropriate category of weighting approaches for the 
weighting across environmental impact categories. Some 
methods give a score based on dimensionless weights, and 
some are expressed in monetary terms. As the monetised 
scores refer to effects not reflected in market prices they 
may be referred to as monetised external costs, also named 
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shadow prices. If priced accordingly in real markets, the 
external effects would be internalised. There are several 
methods which lead to monetised values for the effects 
considered. Also, the non-monetised weights may easily 
be converted into monetised ones if one of the effects in 
the weighting scheme is given a monetised reference. All 
other effects then follow suit. However, some caution is 
required here, as for example the choice of the reference 
will determine the outcome. 

Figure 2 presents several monetizing methods and their 
possible levels of damages or cost. The private preference- 
based method as willingness-to-pay is most fitting in the 
economic valuation approach. The marginal valuation in 
principle is relative to a reference situation. With lower 
emission levels, the value of the damages resulting will be 
lower in principle, the curve showing a demand for emission 
reduction. Reversing the legal status, as in asking the will¬ 
ingness to accept damages, will lead to differing results, for 
example because one cannot pay more than one’s income to 
prevent damage, but may easily require a much larger sum 
to accept the damage occurring. 

The curves as sketched are not empirically available but 
reflect general notions as to the form of supply and demand 
relations. The equilibrium point 2 is what ideally is speci¬ 
fied, at a certain point in time. However, this point, to be 
specified dynamically, is not available empirically. The core 
issue to note here is that all other methods may deviate 
substantially from this “ideal” damage valuation method. 
Current policy-induced emission reduction cost may be an 
order of magnitude lower, while cost currently incurred for 
private considerations may be an order of magnitude lower 
again. The cost of reaching targets, often used as a proxy for 
missing data on willingness-to-pay, may be substantially 


€ damage / 
cost i k 



marginal emission 
reduction cost curve* 


damage per marginal unit 
of emission (WTP) 



reference 
situation 
(in ‘year x) 


emission / damage 
reduction 


Fig. 2 Monetary values for selected methods 


lower, or substantially higher than the ideal willingness-to- 
pay or proxies to that. For higher targets the cost usually 
surge to orders of magnitude above the blue line. Minimum 
and maximum scores hence may easily differ more than two 
orders of magnitude. Mixing monetising methods therefore 
is unallowable if interpretable results are to be produced, 
with a validity which can at least be discussed. The preci¬ 
sion in economic evaluation allows for this analysis. In more 
loose approaches to evaluation, such issues do not come to 
the fore; they remain hidden. 


4 Operational methods considered: survey 

As a first step towards recommendation of a weighting 
approach for measuring the EU overall environmental im¬ 
pact several operational weighting methods have been sur¬ 
veyed (Huppes and van Oers 201 la,b; original 2009). 
Table 1 gives an overview of the quantified operational 
weighting methods that have been analysed, with the ones 
used in the meta-method in shown in italics. The taxonomy 
(see Fig. 1) is used for classifying relevant approaches. 
Furthermore, at a more practical level several additional 
criteria apply, such as: weighting procedure (e.g., distance- 
to-target [DTT], panel); modelling of cause-effect chain; 
environmental interventions covered; environmental 
impacts covered, etc. We always use the ILCD Handbook 
methods for life cycle impact assessment as a reference. 

The overall conclusion of the survey is that the methods 
classified under “collective revealed preferences” are not 
based on the evaluation of different expected effects and 
thus lack an explicit weighting step across impact catego¬ 
ries. These methods use distance-to-target for weights, or 
effectively also other measures, like prevention cost or some 
green taxes, to specify an overall score. For some methods 
the hybrid nature made it impossible to classify them in the 
framework, like the CIRAIG method by Soares et al. (2006). 
Similarly, domain specific weighting methods could not be 
used, like the BEPAS method by Zhang et al. (2006). The 
method of weighting not only may be a mixed one but often 
it just is not clear conceptually, building on several other 
previous studies. Some weighting methods might better not 
be called by that name. In a distance-to-target method, the 
“targets” may all be weighted “equally” and so no reasoned 
weighting across impact categories is applied, only a quite 
random and scale dependent one-one-weighting set. As to 
the methods classified under “single item methods,” these 
technically are no weighting methods because they refer 
only to one impact category. One might interpret them as 
weighting methods placing a fully dominant weight at the 
issue chosen, like the carbon footprint leaving out all non¬ 
carbon effects. This leaves the methods based on stated 
preferences as basis for further development of a weighting 
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Table 1 Classification of quantified operational weighting methods 

Modelling level 

Weighting type 






Collective stated 

Collective revealed preferences 

Individual stated 

Single item methods 


preferences 



preferences 







Non-monetised 

Non-monetised 

Monetised 

Monetised 



Panel 1 

DTT 

Damage prevention 
cost 

WTP Panel 3 


Interventions 

Ecotax (98/02/06) 

Ecopoints (Frischknecht et al. 



Ecological Footprint (Wackemagel 


(Finnveden et al. 

2006; Eldh 2003) 

2008) 



et al. 2005) 

Midpoint 

BEES and EPA (Lippiatt 

EDIP (Wenzel et al. 1997; 


Ecovalue08 (Ahlroth and 

Cumulative. Fossil Energy 


2007) 

Hauschild and Wenzel 


Finnveden 2009) 

Demand, CED (Huijbregts 



1998) 



et al. 2006) 


Nogepa (Huppes et al. 2007) 





Endpoint 



ReCiPe-shadow prices 

ReCiPe-damage cost 





(de Bruyn et al. 2010) 

(Heijungs 2008) 



Ecoindicator99 (Goedkoop 


Eco-costs/Value Ratio 

LIME (Itsubo et al. 2004). 



and Spriensma 2000) 


(Vogtlander et al. 2009) 

EPS (Steen 1999a,b) 

Budget constrained WTP 






(Weidema 2009) 


Integrated modelling 




NEEDS (Preiss and Klotz 

Damage cost GHG emissions (Tol 

and weighting 




2008) 

2008; Stem 2007) 

Damage cost resource extractions 






(Weitzman 1999) 


tool, be they individual utility-based or having some collec¬ 
tive preference or value element. We added some single 
issue methods which may complement other conceptually 
similar methods, as for climate change and resource 
depletion. 

However, there is no well-defined total set of methods 
from which to make a choice. In the LCA domain there are 
earlier survey studies, as by Finnveden (1999) and Ahlroth 
(2009). To cite Finnveden: “The major conclusion is that 
none of the presently available methods can be recommen¬ 
ded for use as an LCA valuation (weighting) method today. 
This is mainly because they either suffer from significant 
data gaps, include inconsistencies, lack justification of ma¬ 
jor assumptions, or because they are not valuation methods 
at all.” In the economics domain, there is a good survey on 
the panel studies that have been used as a basis for mone¬ 
tization by Turner et al. (2004). For the domain of climate 
policy only, Tol (2008) has given a survey of outcomes of a 
large set of studies, with nearly the same material as used in 
the NEEDS study (Tol 2006). Summarizing the situation is 
sobering. There is not one clear set of weighting methods to 
choose from; the criteria for selection of relevant ones from 
this hypothetical set are soft; and as indicated here, applying 
these criteria often is not practically possible due to the 
mixed and unknown nature of methods. 

With all these considerations in mind, a selection of 
methods has been made from a not-encompassing survey 
(see Table 1). Next, a choice of operational methods was 
made to use in the meta-weighting tool as has been devel¬ 
oped. For a more detailed analysis for reasons of inclusion, 


see Huppes and van Oers (2011a), where 14 methods have 
been described in more detail. We would have liked to 
include only clear single-method stated preference 
approaches, with broad applicability. But that would have 
excluded almost all of the available ones. So, a slightly dirty 
choice was unavoidable. 


5 Methods specified: three basic approaches 

5.1 Modelling and evaluation 

The remaining methods can be typified into three categories, 
based on the modelling characteristics and the method of 
weighting, all giving results in terms of a judgement on the 
seriousness of expected effects involved. 

(1) Midpoint modelling and evaluation: BEES, EPA 
(Lippiatt 2007), NOGEPA (Huppes et al. 2007). 
Midpoint weighting methods stop modelling at the 
midpoint level and implicitly leave the assessment of 
further effects to the subjective judgment of panel 
members in the weighting procedure. The members 
then should be knowledgeable and authoritative. 

(2) Endpoint modelling and evaluation: Ecoindicator99 
(Goedkoop and Spriensma 2000), LIME (Itsubo et al. 
2004), ReCiPe damage (Heijungs 2008). In the end¬ 
point weighting methods, there is a formalized model¬ 
ling of the causal chains from midpoint to endpoint. 
Subsequently, the weighting is based on endpoint 
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effects. The valuation of endpoints can be based on 
panels linked to this specific approach, or they may use 
the more general panels as being used by economists to 
quantify the value of externalities 
(3) Integrated modelling and evaluation: NEEDS (Preiss 
and Klotz 2008) + Weitzman (1999). Outside the do¬ 
main of the ILCD, integrated models have evolved, 
linking environmental interventions to damages of 
endpoints and valuation of damages using damage 
cost. These models mostly have been developed in 
relation to economic valuation, as in models for cli¬ 
mate change and for toxic effects on human popula¬ 
tions. The NEEDS method (Preiss and Klotz 2008) 
lacks the valuation of the depletion of abiotic resources 
and therefore is supplemented with the valuation based 
on the conceptually similar Weitzman (1999) data. The 
panels used for economic valuation ideally are repre¬ 
sentative of the general population. In the integrated 
modelling the intermediate effects on midpoint and 
endpoint level are modelled in a combined way, but 
not explicitly presented, so mutual consistency cannot 
be established. 

All methods are based on the aggregation of interventions 
into effects based on formalized modelling and a subsequent 
subjective weighting across these effects. Figure 3 shows 
the overall procedure of impact assessment using character¬ 
isation and weighting across impact categories. 

The results of this characterisation, the impact scores, are 
still hard to interpret. The scores for the different impact 


categories are expressed in different units. To facilitate the 
interpretation in LCA often a normalization procedure is 
used. If the environmental impact assessment includes a 
weighting across impact categories into one overall environ¬ 
mental impact score the normalization is a necessary step in 
case panel weighting is used (e.g., BEES, NOGEPA, 
Ecoindicator99, LIME [dimensionless set]). In case the 
weighting is based on monetized valuation of damages, the 
normalization (e.g., ReCiPe damage cost, NEEDS) is not 
necessary but may be applied in order to arrive at similar 
outcomes. 

So, after normalization for each impact category the 
normalized score of the case study is given. This normalized 
score expresses the relative contribution of the case study to 
the impact score based on the interventions of total society, 
here the total world economy. So for, each of the impact 
categories the result is expressed as a fraction of contribu¬ 
tion to the total world problem. For this purpose, informa¬ 
tion is needed on the total of extractions and emissions in 
the world. These reference interventions are taken from a 
recent normalization study (Wegener Sleeswijk et al. 2008). 
The reference situation here refers to the extractions and 
emissions by the world in the year 2000. 

5.2 Methods quantified 

The factors necessary for the impact assessment of the 
overall environmental impact of the EU27 interventions 
are reported in a spreadsheet that accompanies this article. 
The spreadsheet contains characterisation factors (ILCD 


Fig. 3 Overall set up of impact 
assessment for the selected 
approaches 
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Handbook on LCIA; EC-JRC European Commission-Joint 
Research Centre 2011), normalisation factors (Wegener 
Sleeswijk et al. 2008), and weighting factors (Table 2) and 
can be downloaded from CML (see Appendix 1). Table 2 
shows a summary of the weighting factors based on differ¬ 
ent weighting methods. The weighting factors of the original 
weighting sets have been adapted to align with the impact 
categories as defined in the recent ILCD Handbook on 
LCIA (EC-JRC European Commission-Joint Research 
Centre 2011). The selected weighting methods all have 
operational weighting factors. The midpoint weighting fac¬ 
tors needed limited data transfer in order to comply with the 
ILCD recommended characterisation factors (Huppes and 
van Oers 2011b). The recently developed set of character¬ 
isation factors seemed to be not yet fully consistent in the 
modelling of midpoint and endpoint factors and have been 
adapted where possible. 

The integrated modelling and weighting according to 
NEEDS is only available for a limited number of emissions 
to air. Estimation of factors for missing emissions of 
NEEDS is based on data transfer using the ILCD character¬ 
isation factors as extrapolation factors. For details, see 
Huppes and van Oers (2011b). The effect of equalized 
applicability is a convergence between NEEDS and the 
midpoint-based weighting methods. The degree of conver¬ 
gence of course depends on the case. If the case is dominat¬ 
ed by emissions already present in the unadjusted NEEDS, 


there is no convergence induced, and vice versa. NEEDS 
factors also lack the valuation of the depletion of resources, 
one full impact category. For this reason, the NEEDS factors 
are supplemented with Weitzman’s economic approach to 
depletion (1999). In NEEDS the marginal damage cost for 
C0 2 emissions is set at €6/ton C0 2 (no equity weighting, 
3 % discount rate; see Preiss and Klotz 2008). These orig¬ 
inal damage cost for emissions of greenhouse gases (GHGs) 
in NEEDS have been raised with a factor 10, to allow for 
effects not covered in NEEDS, including the low-chance, 
high-impact effects (see Weitzman 2009). These figures 
correspond reasonably with the figures as used by Stem 
(2007). The NEEDS factors are only available on the level 
of substance emissions. For an overview of the original 
NEEDS factors and extrapolated and adapted values please 
refer to the spreadsheet. Normalisation factors are based on 
the total of interventions (emissions and extractions) in the 
world in 2000, taken from Wegener Sleeswijk et al. (2008). 

6 Three basic approaches combined 

The three impact evaluation procedures are conceptually 
different. They model the intervention-effect chain but are 
different in the level to which the effect is modelled, i.e., 
midpoint “state” indicators, endpoint “damage” indicators 
or “damage cost” indicators. The midpoint and endpoint 


Table 2 Adapted weighting factors based on different weighting methods 


Area of 

Protection 

Impact category on 
midpoint level 

Weighting method 







EPA Science Adv. 

BEES Stake- 

NOGEPAwith 

Lime 

Eco indica-tor99 

ReCiPe dam. 

NEEDS dam. cost 





Board 

holder Panel 

add. factors 



cost 

(some examples) 



% 

% 

% 

% 

% 

$/unit dam. 

€/kg em. 

Human Health 

Climate change 

16 

29 

25 

33 

30 

60,000 

0.06 (C0 2 ) 


Ozone depletion 

5 

2 

4 






Human health cancer. 

7 

8 

5 




3.7E7 (dioxin) 


Human health non-cancer 

4 

5 

3 




278 (lead) 


Particulate matter/respiratory 

6 

9 

5 




6.07 (S0 2 ) 


inorganics 

Ionising radiation, human 

6 

2 

3 




0.0014 (Cl4) 


health 

Photochemical ozone 

6 

4 

6 






formation 








Natural environment 

climate change 

N/A a 

N/A s 

N/A a 

52 

40 

1.75E11 



Acidification 

5 

3 

5 






Eutrophication 

5 

6 

10 






Fresh water ecotoxicity 

11 

7 

15 






Ionising radiation, 

6 

2 

3 






ecosystems 








Resources 

Abiotic resource depletion 

5 

10 

6 

14 

30 

1 

0.00103 (oil) 


Water intake 

3 

8 

4 






Land use 

16 

6 

8 






a The ILCD recommended characterisation on midpoint level does not distinguish between climate change impacts on human health and ecosystem 
health 
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modelling and weighting build on the characterization 
according to the ILCD recommended set of characterisation 
factors. The integrated modelling and weighting methods 
according to NEEDS builds, implicitly, on detailed distribu¬ 
tion, fate and effect models. These models differ from the 
models recommended in the ILCD Handbook. However, 
their status outside the LCA community is well established, 
also in the policy domain. Therefore, we include them as 
one of the three approaches to weighting in the combined 
weighting method. 

All methods suffer from inconsistencies in modelling of 
the impacts for different impact categories. For example, the 
modelling of the time scale, spatial scale, treatment of back¬ 
ground concentrations and multimedia distribution is differ¬ 
ent for different impact categories. These differences are 
most apparent for the midpoint effects which are defined 
for different time and spatial scale levels but just are hidden 
from view in the other methods. Correction of these differ¬ 
ences in the weighting makes this procedure even fuzzier. 
However, the midpoint to endpoint modelling should also 
deal with these differences. This makes the endpoint mod¬ 
elling even more uncertain. 

The three groups of methods each have their relative 
strengths and weaknesses, on which different views are very 
well possible (Huppes and van Oers 2011a). Midpoint 
approaches have a clear modelling basis with mutually 
inconsistent elements and they rely on extensive subjective 
estimates in the combined further-modelling- and weighting 
step. Endpoint models have a weak modelling step after the 
midpoint and then are conceptually similar to the valuation 
step in the economics oriented integrated modelling and 
weighting. The underlying specification is poor, however, 
compared to the integrated modelling approach. The inte¬ 
grated modelling approach has some strong points in mod¬ 
elling, as in climate modelling and human toxicity, but is 
weak in its further modelling. The valuation step of this 
approach is best specified, based on thoroughly tried but not 
undisputed methods. 

As to the right method, it seems that neither is perfect, 
nor will one method be generally accepted. 

The basic choice on a framework for evaluation, the 
internal inconsistencies in underlying modelling, and the 
rather haphazard nature of many choices involved all indi¬ 
cate that the choice for one method is not the right direction 
to go now, or in the foreseeable future. Just adding another 
weighting set, an improved one, would hardly improve the 
overall situation. A major effort on environmental model¬ 
ling is due, to make methods more consistent and then also 
more similar. More precise links to evaluation then can be 
established as well. 

For now, we have chosen a most open solution, reckon¬ 
ing with the different approaches and methods, but not 
leaving all choices open. The seven most broadly applicable 


and consistent methods have not just been chosen. Each of 
them has been made as consistent as possible and has been 
expanded as much as possible so as to apply to the same 
broad set of environmental interventions as present in actual 
situations of environmental evaluation and choice. The 
NEEDS approach also has been expanded so as to cover 
resource depletion. Though fundamentally different in struc¬ 
ture, the three approaches thus are directly comparable in 
their results, linking environmental interventions to weight¬ 
ed results. Also, by using the same methods for establishing 
normalisation data, they can be adapted easily to new sets of 
data becoming available and can easily be used for scenario 
analysis using possible future sets of total environmental 
interventions. 

Improving the modelling behind the evaluation is possi¬ 
ble, leading to adapted characterisation factors. Adding new, 
different, characterisation factors would require new weight¬ 
ing procedures. 

A special question is how to deal with missing interven¬ 
tion data, fully for one impact category. Its weight will then 
be zero, automatically for its contribution to midpoint 
scores, and implicitly also for end point methods. It seems 
no special adaptation for such a situation is required. It is 
clearly visible in the results. Some more detailed analysis 
might due here. 

To allow for easy application, and for easy adaptation 
regarding new developments, the weighting procedure has 
been implemented in a freely available spreadsheet (see 
Appendix 1). The user may use the default meta-weights 
but may easily adapt the contribution of the different 
weighting sets to the combined result. By setting one meth¬ 
od at 100 %, the weighting by only that method results. 
Table 3 shows an exemplary setting of the selection of the 
weighting methods, as a default. It is the base line in the 
spreadsheet, quite arbitrarily chosen now. The low scores for 
the endpoint methods are based on their lack of transparen¬ 
cy, their not well-developed underlying models and their 
limited correspondence to ILCD. Future developments in 


Table 3 Weighting of methods in the meta-weighting tool 


Type of weighting approach 

Operational 
weighting sets 

Meta-weighting 

set 

Midpoint modelling and 

BEES 

25 

evaluation 

EPA 

25 


NOGEPA 

25 

Endpoint modelling and 

Ecoindicator99 

2 

evaluation 

LIME 

2 


ReCiPe damage 
value 

1 

Integrated modelling and 

NEED S+Weitzman 

20 

evaluation 


100 
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characterization models and weighting values might lead to 
further convergence of the methods and approaches, but also 
to divergence especially where treatment of time frames 
differs. 

7 Exemplary application to country level time series 

As an illustration of the use of the weighting factors for a 
decoupling indicator, the impact assessment has been ap¬ 
plied to a broad data set with time series for the EU. Ideally, 
such a data set should encompass a broad set of impact 
categories related to a broad set of environmental interven¬ 
tions monitored over a long period of time. However, many 
empirical time series of inventory data, like NAMEA, are 
poor concerning the time span they cover and the emissions 
they take into account. For this reason, the time series of 
inventory data are constructed data. The outcomes, there¬ 
fore, are exemplary, giving a rough indication only. Direct 
times series data should be produced in due time. 

The constructed inventory data are based on materials use 
for which data are more readily available combined with 
LCA type of process data to deliver a rich set of interven¬ 
tions, as a time series. The result is the Environmentally 
weighted Materials Consumption indicator (EMC). The 
EMC was drafted as an option for the overall economic- 
environmental decoupling indicator to support the EU 


Thematic Strategy on Natural Resources (Van der Voet et 
al. 2005, 2009). 

Figure 4 depicts the scores for the midpoint impact cat¬ 
egories. These show quite some variation in their develop¬ 
ment, hence requiring weighting for arriving at an overall 
view regarding decoupling. Figure 5 gives the weighted 
score per method and for the combined method, the meta¬ 
weighting score in dark blue. Most striking is the fact that 
methods from such diverse evaluation backgrounds and 
with such different modelling involved still converge so 
much. Is there an underlying convergence mechanism which 
leads to this result? One such a mechanism might be the 
tendency for researchers to leave out outliers. In the process 
of combining different studies, so well described by Turner 
et al. 2004), this may well lead to convergence, especially if 
enough iterations follow. 

Table 4 shows the relative contribution of substance- 
compartment-emissions to the total environmental impact 
score of the EU28 in the year 2000. The results are based 
on the separate different weighting sets. This top 20 of 
substance-compartment-emissions contribute for about 
90 % to the total environmental impact score. The general 
picture of most dominant emissions is more or less the same 
for all weighting methods. 

Most dominant emissions are, on average, carbon dioxide, 
dioxin, carbon-14, hydrogen-3, zinc, mercury and nitrogen di¬ 
oxide. Also, other GHG emissions, like methane and di-nitrogen 



year 


—♦—Climate change midpoint 

—■—Ozone depletion midpoint 

Human toxicity midpoint, cancer effects 

Human toxicity midpoint, non-cancer effects 

—*— Particulate matter/Respiratory inorganics 
midpoint 

—•—Ionizing radiation midpoint, human health 

—i— Ionizing radiation midpoint, ecosystems 

- Photochemical ozone formation midpoint, 

human health 

Acidification midpoint 

Eutrophication terrestrial midpoint 

Eutrophication freshwater midpoint 

Eutrophication marine midpoint 

Ecotoxicity freshwater midpoint 

R e sourc e d e p le t i on wat e r, m i dpo i nt 

Resource depletion, mineral, fossils and 
renewables, midpoint 

l and us e 
-■-GDP 


Fig. 4 GDP and normalised impact scores per midpoint impact cate- through impact categories are not yet available in the latest version of 

gory for the EU15 in the year 1990-2000. (Intervention profiles for the ILCD characterisation factors) 

years are based on EMC (van der Voet et al. 2005, 2009); strike- 
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BEES 

EPA 

NOGEPA 


Ecoindicator99 

LIME 


ReCiPe damage 
NEEDS 

Combined Weighting Method 
GDP 


year 


Fig. 5 GDP and environmental impact scores for the EU15 in the years 1990-2000. (Intervention profiles are based on EMC; Van der Voet et al. 
2005, 2009) 


oxide, bulk emissions like sulfur dioxide, NMVOCs and PM10 This list of top 20 emissions is, more or less, in line with 
are part of the top 20. The remaining of the top 20 mainly general expectations, but there is quite some discussion 
consists of emissions of pesticides to the soil. possible on why some scores are so high, and others so 

Table 4 Contribution of substance intervention/compartment to the weighted impact score of EU28 in 2000 (%) 

Midpoint modelling (ILCD) Endpoint modelling (ILCD) and Integrated modelling and 

and weighting weighting valuation 


Substance 

Compartment 

BEES 

EPA 

NOGEPA 

Ecoindicator99 

LIME 

ReCiPe damage 

NEED S+Weitzman 

Carbon dioxide 

Air 

22 

11 

19 

9 

9 

16 

37 

Carbon-14 

Air 

5 

16 

9 

16 

16 

10 


Mercury 

Air 

12 

9 

7 

9 

9 



Zinc 

Air 

9 

7 

6 

8 

8 


4 

Hydrogen-3 

Air 

3 

10 

6 

13 

15 

56 


Benzene 

Air 

8 

6 

5 

5 

5 



Nitrogen dioxide 

Air 

5 

5 

7 

3 

3 


13 

Sulfur dioxide 

Air 

3 

3 

3 

3 

3 


9 

Methane 

Air 

3 

2 

3 

1 

1 

2 

9 

Lead 

Air 

3 

2 

2 

3 

2 



Chlorpyrifos 

Agri-soil 

1 

2 

3 

1 

1 



Nitrous oxide 

Air 

2 

1 

2 




21 

Particles (PM 10) 

Air 

2 

1 

1 

1 

1 


1 

Atrazine 

Agri-soil 

1 

2 

2 

1 

1 



Iodine-131 

Air 

1 

2 

1 

3 

4 

13 


Chlorothalonil 

Agri-soil 

1 

1 

2 

1 

1 



Non-methane VOC 

Air 

1 

1 

2 

1 

1 


2 

Phosphate 

Water 

1 

1 

2 

4 

4 



Formaldehyde 

Air 

2 

1 

1 

1 

1 



Cyanazine 

Agri-soil 

1 

1 

1 





Total 


85 

86 

84 

84 

86 

97 

94 
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low. For example, C14 and hydrogen-3 belong to the high¬ 
est ranking emissions, as the combined effect of the charac¬ 
terisation score of C14 and hydrogen-3 as a radioactive 
emission, and the weight of radiation in the weighted score. 
So, the question is, whether or not this is correct. Is the 
estimated emission too high? Or is there a mistake in the 
impact assessment, in the characterisation factor or weight¬ 
ing factor for ionizing radiation? ReCiPe damage cost seems 
to be completely dominated by damages to ecosystem health 
caused by radiation and emissions of C0 2 . Again, this might 
be caused by an incorrect modelling in the characterisation 
from midpoint to endpoint indicators and/or by weight set 
too high in the valuation of damages to ecosystems. The 
impact score based on NEEDS is completely dominated by 
the emissions of GHG that make up 60 % of the impact 
score. Table 4 shows the contribution of interventions to the 
total impact score for each method. 

8 Discussion 

Quite some second-best choices have been made in devel¬ 
oping the meta-weighting set. When interpreting the results 
of the seven presented impact assessment and weighting sets 
several comments can be made which underline that the 
presented results should be considered preliminary and that 
further development of both the characterisation and weight¬ 
ing is necessary. There is incompleteness in modelling. The 
present version of the ILCD Handbook recommended char¬ 
acterisation lacks the assessment of two impact categories, 
land use and water depletion, that in principle should be 
considered. NEEDS focuses only on air emissions of GHG 
and classical bulk emissions to air. Important missing im¬ 
pact categories are damage to ecosystems by toxic releases, 
land use and depletion of water. The last two are, at the 
moment, also missing in the ILCD characterisation. These 
omissions are partly recovered by data transfer using ILCD 
factors as extrapolation factors. The consequence of this 
data transfer is that the impact assessment will resemble 
ILCD-based impact assessment for these extrapolated 
NEEDS data. 

The available modelling seems inconsistent is several 
respects. The midpoint to endpoint modelling as indicated 
conceptually in ILCD seems not to have been completely 
elaborated for ecosystem health, in any method. There is no 
consistent set of endpoint indicators yet. In this weighting 
project a rough provisional conversion is applied in order to 
be able to aggregate the scores in an equitable way, and in 
order to link methods. This rough provisional conversion 
might be the explanation of some of the oddities in the 
preliminary results. Also attention should be given to de 
modelling of ionizing radiation because the present charac¬ 
terization factors results in an unexpected high contribution 


of radioactive emissions to the total environmental impact 
score, due to C14 emissions. 

Some further consistency aspects should be considered 
when evaluating scores based on characterisation models. 
The evaluation of scores will become complex when they 
have to reckon with inconsistencies between the character¬ 
isation models used for different impact categories, like differ¬ 
ences in time scale and/or geographical scale of the effect and 
whether or not background concentrations are taken into 
account. In the present set of ILCD characterisation factors 
for example, the impact assessment of climate change is based 
on a specified time horizon (e.g., 100 years), while, by con¬ 
trast, fate modelling for the toxicity scores is based on an 
infinite time horizon, without discounting. Integrated model¬ 
ling has a long time horizon but then discounts. How dis¬ 
counting might fit into LCA is an open question (see Hellweg 
et al. 2003). On a geographical scale there are differences 
between the global models, like climate change and ozone 
depletion and the continental or local models, like acidifica¬ 
tion and eutrophication. Finally, background concentrations 
are taken into account in climate change and ozone depletion 
models but not in characterisation of the other impact catego¬ 
ries like in toxicity and eutrophication. Hence, the evaluation 
of assumed effects (midpoint weighting) or the further mod¬ 
elling of effects (endpoint weighting) can hardly be consistent 
in this respect. As time and place, integrated approaches tend 
to have a more well-defined treatment, with quite some un¬ 
derlying disagreement at a more detailed level, for example as 
to the discount rates to be used. As we added toxicity to the 
integrated modelling based on LCA-type reasoning, some 
inconsistency definitely is involved. 

In the integrated modelling and weighting, different costs 
are used to valuate different endpoints (human health, eco¬ 
system health (i.e., eutrophication and acidification), global 
warming and radiation. These involve conceptually different 
options like willingness-to-pay and reduction costs. 
Weighting across endpoints then is not consistent, not in 
terms of decision support where choices on allowable cost 
are involved. This point has been resolved as much as 
possible by using willingness-to-pay as the only base meth¬ 
od in economic valuation. 

9 Conclusions 

For the overall judgement on future impacts of sets of envi¬ 
ronmental interventions, weighting based on explicit evalua¬ 
tion methods seems to be the most appropriate approach, 
surely as compared to unspecified and ill-communicated 
methods, and the more so as compared to unsubstantiated 
choices. Reluctance on using quantified evaluation methods, 
as often encountered in ecological economics, is understand¬ 
able but not a valid position if specific choices are to be made. 
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Discussion on explicit weighing is the more important as 
there is not one right method, nor will one method be 
generally accepted. Different weighting methods each have 
their relative strengths and weaknesses. Selecting one as the 
best therefore is not possible. The best approach for now is 
to explicitly combine the three different approaches for 
evaluation, using relative pure methods, into a single meta¬ 
weighting method, showing the contribution of each under¬ 
lying method, and showing where they agree and differ in 
the case at hand. The combined method transforms the 
environmental interventions via environmental effects into 
one environmental indicator score, as an overall evaluation. 
As there is no best single method, the combined weighting 
method should easily be varied as to the contribution of the 
individual methods in determining the outcome. It now can 
create a “best weighting-related practice.” 

The application to a time series of aggregate European 
data shows that there is no wide divergence between the 
different weighting methods when applied to such macro 
level data. This means that the choice of specific weighting 
methods may not have an overarching influence on out¬ 
comes and the combined set of meta-weights reasonably 
reflects different positions in weighting. When applied at 
cases at a micro level, the methods will diverge more. 

The two-step procedure of first weighing environmental 
aspects into an overall score and next relating this score to 
cost and value creation is not recommended in multi-criteria 
analysis. A single overall evaluation step is recommended 
there. The two-step procedure seems a most practical ap¬ 
proach for now, however, next linking the two domains 
loosely as in eco-efficiency analysis. This also is the case 
due to differences in effect modelling between the two 
domains. Improving the effect modelling behind underlying 
impact categories is well possible, then leading to adapted 
characterisation factors. The change and addition of new 
midpoint impact categories would require new weighting 
procedures, for all methods. The state of the art in impact 
assessment and weighting is not final because of devel¬ 
opments in modelling of effects and because of changes 
in subjective choices. Main deficiencies and inconsisten¬ 
cies in modelling and evaluation should be resolved, 
especially in the now quite chaotic treatment of time 
in different modelling steps and in terms of regional 
differentiation of effects. 

An open discussion on the as yet ill developed environ¬ 
mental evaluation subject is due, also at a conceptual level, 
then making next steps in the sustainability discourse. 


Open Access This article is distributed under the terms of the 
Creative Commons Attribution License which permits any use, distri¬ 
bution, and reproduction in any medium, provided the original author 
(s) and the source are credited. 


Appendix 1 

A spreadsheet translates emissions into the three main eval¬ 
uation methods, which can be combined into a single score 
using a meta-weighting set. It can be downloaded from: 
http://www.leidenuniv.nl/cml/ssp/databases/weighting/ 
weighting_environmental_impacts_metamethod_ 
version_L0.zip. 
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